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Background 



Nonlinear programming problems which are not convex programs are trouble- 
some because they may possess local optimal solutions which are not global 
optimal. In [1] an algorithm is developed for globally optimizing separable 
nonconvex programs. The purpose of this note is to generalize the optimality 
test of this algorithm to include e tolerances and thus to make it suitable 
for computer implementation where inexact arithmetic requires the use of such 
tolerances. The notation in this paper is the same as that in [1]; we will 
briefly summarize the algorithm in this paper, but for details the reader is 
referred to [1] . 
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Abstract of Algorithm 



We consider the separable nonlinear programming problem 

A ^ 

NLP min f(x) = ^ , 

j=l 

A ^ 

subject to g. (x) = 51 g. (x ) ^ 0 i = 1, m 

j=l 

a^x.^b. j=l, ...,n 
J J J 



The global optimization algorithm under consideration is an incorporation 

of generalized linear programming into a branch and bound structure. At each 

stage of the branch and bound search, NLP is approximated by inner linearization 

resulting in an approximating restricted master linear program called P. 

A 



whose decision variables X., are weights for convex combinations of fixed 

J A 

grid points x 

jlc . 



X : min T T X f . (x ) 

j k J 



(2) 



subject to ^ 51 ^ (Xj ^0 i = 1, ...,m 



I ^ 



j = 1, . . . , n 



X., s 0 . 

Jk 

Solution of yields primal variables X , dual variables ir e R® , oeR^ , 

and objective function value Z . The dual variables tt from the restricted 
master are then used to form single variable Lagrangian subproblems 
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min 



(3) 



m 






a., ^ X . ^ "b. 
3 3 i 



with (global) solutions 



X . . 

3 



The primal solution also gives ah approximate solution x* to NLP 

computed from 



’‘"j ■ I ^ " 

An optimality test involving x*^ x, Z and the various functions in 

NLP results in one of the following 



i) 

ii) 

iii) 



X* is globally optimal for NLP 



a new grid point x.^ for the restricted master P, is created 

jx A 



a branch in the branch and bound algorithm is performed by creating 

two restricted master problems , one with x. x* and 

<] J 

the other with x^ ^ x* , 



and the algorithm continues. For further details refer to [1] . 



This paper extends the theorem which validates the above mentioned optimality 
test . 






Exact Optimality Theorem 



The following theorem is proved in [1] 



Let C = {xla.:^ x.^ b.} 
' J J 3 



Theorem 1 Let X be primal optimal and (Tr,a) dual optimal for P 



X with 



objective function value Z . Let x* have components x* 

J 

If a) X globally solves 






jk jk . 



A V 

min L (x, tt) = ^ 
J 

xeC 



(5) 



b) f(x^) ^ Z , 



c) g^(x*) < 0 Vi=l, ...,m, 



and 



n 



d) L(x, 7t) ^ lo , 



J=l^ 



then X* solves NLP (globally) 



Proof See [1] , 



To m_ake such a theorem useful in the context of a computer program we must 
realize that computer arithmetic is not exact, and consequently even if the 
conditions of the theorem are met , they may appear to be only approximately 
met in the computer. Furthermore, in solving the Lagrangian subproblems (5) 
the computer will generally be unable to obtain the exact solution, so again 
we must introduce e tolerances. 



The chief goal of this paper is to prove a theorem like Theorem 1 where 

each of a, b, c, d has a tolerance included. 
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£ - Optimality 



Consider the optimal objective function value of NLP (l) as a function 



m 



of a general right hand side vector deP and define the extremal function 



{f(x)|g. (x) ^ d. , i = 1, m; 



inf 



a, ^ X . ^ b. } 

J J J 



Definition 

such that 



^inf right - continuous at d = d 

d ^ d ^ d + 6 implies f . ^ (d) + e ^ f . 

^ inf inf 



iff 
(d) . 



Ve > 0 , 36 > 0 
(note 6eR^) 



Definition We say that NLP is stable iff is right continuous 

at d = 0 . 



Lemma 1 If rr ^ 0 then min L(x, rr) ^ ^i^f 

xeC 

Proof Standard result from nonlinear duality. 



The main result is the following theorem. 



Suppose as in Theorem 1 that X is primal optimal and (n,a) is dual optimal 

for the restricted master linear program P^ with optimal objective function 

value Z . Let x* have components x* = Tx x 

J ^ • 



Theorem 2 Suppose NLP (l) is stable. Given any e > 0 , 36 > 0 such 



that if 


a) 


L(x,it) ^ rain L(x,tt) + e/l+ 
xeC 


(6) 




b) 


f(x*) ^ Z + e/k 


(T) 




c) 


g(x*) ^ 6 


(8) 




d) 


L(x,it) + e/U ^ L. 

j=lj 


(9) 
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then X* is globally e - optimal for NLP . 



Proof By stability ve can select 6 > 0 such that if g(x*) ^ iS then 

f(x*) + e/U ^ f. (6) + zfh > f. „ (O) = min {f(x)|x feasible}. (lO) 

for NLP 



Now at optimality for ve have equal primal and dual objective function 

values . 



I Ix 

J k 



Jk 




= Z 



n 




( 11 ) 



and dual feasibility for implies 



7T < 0 



( 12 ) 



Thus Lemma 1 implies 



min L(x,tt) < min {f(x)|x feasible for NLP} . (13) 

xeC 



Using (ll), (9), (6), (13), (10) and ( 7 ) in that order gives 

Z = . 5 L(x,x) + z/k 5 min L(x,tt) + z/h + z/h 5 min {f(x)|x feasible for NLP} + e/2 

^ xeC 

5 f(x*) + z/h + e/2 £ Z + e . 

Thus all of the quantities in the above inequalities are within e of each 
other, and consequently f(x*) is within e of being (global) optimal for 
the original problem NLP. 
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stability Conditions 



Examination of the proof of Theorem 2 shows that the stability of NLP 
is crucial to the demonstration of e - optimality. It is therefore vital to 
determine when we can expect the extremal function right continuous 

at 0 . Some results on the problem are presented in [2] and the relevant 
ones will be repeated here without proof. 

Let S^ = {x|g(x) <d, xeC} , then S^ is the feasible region for NLP . 

Note that S^ is a compact set since C is bounded. Assume g^ is continuous 
= 1, . . . , m . 

Definition Suppose S^ is compact. The point to set mapping S:d -► S^ 

is said to be upper semi continuous (u. s. c.) at d = 0 iff Ve > 0 36 > 0 
such that ld| < 6 S^ c N (S ) . 

In words, a small increase in the right hand side of NLP cannot lead to a 
discontinuous expansion of the feasible region. 

Theorem 3 The mapping S is u.s.c. atO iff 3d >0 such that S~ is 
compact . 

Note that S~ is compact for any d in our NLP since C is bounded, thus for 
any increase in the RHS of the g constraints , the feasible region 
changes continuously. It should also be noted that for decreases in the RHS 
the problem is much more complex (see [2]) but fortunately our e optimality 
theorem does not require this case. 
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Theorem U If f(x) is a lover semicontinuous function and S is u.s.c. 



at 0 5 then right continuous at 0. 

These results imply that the e - optimality theorem is valid for a vide 
variety of non-convex programs. In particular f, g continuous over C 
that NLP is stable at 0 . 



implies 
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